Replica theory for Levy spin glasses * 



K. Janzen0 A. K. Hartmann0 and A. EngeH 
Institut fiir Physik, Carl-von-Ossietzky-Universtitdt, 26111 Oldenburg, Germany 

Infinite-range spin-glass models with Levy-distributed interactions show a spin-glass transition 
with similarities to both the Sherrington-Kirkpatrick model and to disordered spin systems on 
finite connectivity random graphs. Despite the diverging moments of the coupling distribution 
the transition can be analyzed within the replica approach by working at imaginary temperature. 
Within the replica-symmetric approximation a self-consistent equation for the distribution of local 
'^q' ■ fields is derived and from the instability of the paramagnetic solution to this equation the glass- 

' transition temperature is determined. The role of the percolation of rare strong bonds for the 

, transition is elucidated. The results partly agree and partly disagree with those obtained within 

■ the cavity approach. Numerical simulations using parallel tempering are in agreement with the 

' transition temperatures found. 
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I. INTRODUCTION 



' Spin glasses have been one of the most prominent models for disordered systems since the classical paper by Edwards 
and Anderson [l[ . They are built from simple degrees of freedom interacting via random couphngs [2] . The ensuing 
^ ■ interplay between disorder and frustration gives rise to peculiar static and dynamic properties which made spin- 
"j^ , glasses paradigms for complex systems with competing interactions. The concepts and techniques developed for their 
theoretical understanding became useful also in the quantitative analysis of problems from algorithmic complexity 
[lifllEl, game theory [1,13, artificial neural networks 8, 9], and cryptography ^1^. 
• A comprehensive understanding of spin glasses is so far possible on the mean-field level only. Different models of 
^ I mean-field spin glasses have been introduced and analyzed over the years. The Sherrington-Kirkpatrick (SK) model 
O . [ll[ was designed as generalization of the Weiss model of ferromagnetism. It is the most popular completely connected 
spin glass model in which each spin interacts with all 0{N) other spins via weak couplings Jij = 0{N~^^'^). The 
central limit theorem can then be invoked to determine the statistical properties of the local fields and in the simplest 
■ situation the distribution of these fields is Gaussian and can be characterized by a single scalar order parameter. The 
K*" [ details of the spin glass transition and the intricate nature of the low-temperature phase of this model have been 
thoroughly elucidated within the framework of the celebrated Parisi solution Quite recently the main features 
_ of this solution were established in a mathematically rigorous way [13]. 

, The variety of mean-field models for spin glasses is, however, by far not exhausted by SK-like systems. The 
• ■ Viana-Bray (VB) model and, more generally, spin glasses on finite-connectivity graphs [isl . [l6j combine finite 
coordination number with mean-field behaviour. Here each spin interacts with a finite number of randomly selected 
other spins through strong bonds Jij — 0{1). Accordingly the distribution of local fields is not Gaussian and has to 
] be characterized by all its moments. The analysis of these systems is therefore technically more involved and already 
in the simplest (replica symmetric) description infinitely many order parameters (or equivalently an order parameter 
function) have to be introduced. Models of this type often arise in the analysis of complex optimization problems 
with methods from statistical mechanics 
$-H /^From the technical perspective two different methods were developed to analyze spin glasses within the framework 

5^ of equilibrium statistical mechanics. The replica method P, [13, [ill centers around averages of integer moments of 
the partition function of the system. Its crucial step consists in the analytical continuation of the results for the 
n-th moment of the partition function from integer to real n and the final limit n — > 0. Complementary, the cavity 
method [itI . [l9l [20| builds on the clustering property of equilibrium states and the stability of the thermodynamic 
limit N oo. Here one considers a system with N spins, adds one additional spin with its couplings to the system 
and derives self-consistency relations that stem from the fact that the statistical properties of the N and the iV + 1 
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spin system should be similar to each other. Both the SK and the VB model have been analyzed using the replica as 
well as the cavity method. 

Also from the numerical point of view, spin glasses are a challenging problem. Due to the frustrated interactions and 
since no efficient cluster algorithm exists, it is very hard to equilibrate samples at temperatures below the transition 
temperature. Hence, other schemes like parallel tempering are used frequently, but still sizes of the order of = 1000 
spins are typically the maximum system size one can treat. 

In the present paper we investigate the replica-symmetric (RS) theory of an infinite range spin-glass model for which 
the couplings strengths are drawn from a Levy distribution |21| . The main characteristic of these distributions are 
power-law tails resulting in diverging moments. Spin glasses with Levy couplings are interesting for several reasons. In 
real spin glasses with a random distribution of magnetic atoms in a non-magnetic host lattice the RKKY-interaction 
give rise to a broad spectrum of interaction strengths, in particular for low concentration of magnetic impurities. The 
coexistence of couplings with vastly different strength is badly represented by a Gaussian distribution as used in the 
SK model. Also, it is interesting to see whether the concept of frustration which is central to the understanding of 
spin glasses has to be modified for broad distributions of coupling strengths. Moreover, in a completely connected 
spin glass with Levy distributed couplings each spin will establish 0(1) strong bonds with other spins whereas the 
majority of couplings are weak, i.e. tend to zero for A^ — > oo. Levy spin glasses are hence intermediate between the 
classes represented by the VB and SK model respectively and it is interesting to see how the spin glass transition is 
influenced by the percolation of the strong bonds on the one hand and the collective blocking of the many weak bonds 
on the other hand. 

Levy spin glasses also pose new challenges to the theoretical analysis because the diverging second moment of the 
coupling distribution invalidates the central limit theorem which is at the bottom of many mean-field techniques. 
Related issues of interest include quantum spin glasses with broad coupling distribution [22| . the spectral theory of 
random matrices with Levy-distributed entries |23j, |2 j | , and relaxation and transport on scale- free networks [25j . It is 
also possible that the peculiar properties of Levy distributions may facilitate mathematically rigorous investigations 
of spin glasses. In this respect it is interesting to note that the properties of the Cauchy-distribution have recently 
enabled progress in the mathematically rigorous analysis of matrix games with random pay-off matrices [26| . 

The Levy spin glass was investigated previously by Cizeau and Bouchaud using the cavity method [2l|. Comple- 
mentary, our main emphasis will be on the application of the replica method to the Levy spin glass. As noted also 
by Cizeau and Bouchaud a straightforward implementation of the classical version of the replica method for infinite 
range models [li] is impractical due to diverging order parameters. It is, however, possible to use a variant of the 
replica method that was developed to deal with non-Gaussian local field distributions characteristic for diluted spin 
glasses and complex optimization problems [27j . Until now this approach was used only in situations where the local 
field distribution is inadequately characterized by its second moment alone and higher moments of the distribution 
are needed for a complete description. Here we show that the method may also be adapted to situations where the 
moments may not even exist. 

The paper is organized as follows. After the precise definition of the model in the next section we recall in section 
mil the main steps of the RS cavity treatment performed by Cizeau and Bouchaud. Section HVl comprises our replica 
analysis including the results for the spin glass transition temperature and the influence of a ferromagnetic bias in the 
coupling distribution. In section|V]we describe our numerical simulations and compare their results for the transition 
temperature with our analytical flndings. Finally, section IVII gives a short discussion of the results and points out 
some open problems. 



II. THE MODEL 



We consider a system of N Ising spins Si — ±1, i ~ 1, N with Hamiltonian 

where the sum is over all pairs of spins. The couplings Jy = Jji are independent, identically distributed random 
variables drawn from a symmetric Levy distribution Pa{J). It is defined by its characteristic function (281] 

Pciq) J dJ e-'^J P^{J) = e-l«l° (2) 

with the real parameter a, < a < 2. A Gaussian distribution of couplings as in the standard SK model is obtained 
in the limit a — > 2. 
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Levy distributions are stable distributions which roughly means the following. If Xi,i = 1,...,N are independent 
random variables drawn from a Levy distribution Pa{x) their sum, z = is distributed according toP„(z/iVi/"), 

i.e. z is also Levy distributed with the same parameter a, albeit with a width increased by a factor N^/°'. Corre- 
spondingly the exchange fields 

^r"^ - E -wu-^s, (3) 

in a Levy spin glass are Levy distributed and the scaling of the couplings with l/N^^" ensures that they are of order 1 
for TV — !■ cx) such that the Hamiltonian ([T]) is extensive. 

^From the definition ^ we also find the asymptotic form of P{J) for large | J| to be 

nj) - ^ . (4) 

From this asymptotic behaviour and the interval of admissible values of a it is clear that the second and higher 
moments of Levy distributions do not exist. The long tail of the distribution also implies that the largest among TV 
independent Levy variables is of order N'^^"' , i.e. of exactly the same order as their sum. The sum is hence dominated 
by its largest summands. Each spin in a Levy spin glass is therefore coupled to the majority of other spins by weak 
couplings of order 1/TV^/" and to a few (0(1) for TV oo) by strong bonds of order 1. 

The thermodynamic properties of the system are described by the ensemble averaged free energy 
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with the partition function 



/(/?):=- hm -^ln^(/3), (5) 

TV— »oo pTV 



Z{(3) := J2 exp(-/?i?({5,})) . (6) 



Here (3 denotes the inverse temperature and the overbar stands for the average over the random couplings J, 



III. CAVITY ANALYSIS 



The first statistical mechanics analysis of the Levy spin glass was performed 15 years ago by Cizeau and Bouchaud 
[2l| using a variant of the cavity method. In the traditional form of the cavity method for fully connected systems [l7| 
one considers a system of TV spins {S'i} in a pure equilibrium state and adds TV new couplings Joi, i = 1, TV between 
these existing spins and a cavity which will later accommodate the (TV + l)-st spin Sq. For both the couplings in 
the TV-spin system and for the new couplings one particular realization is considered. The exchange field ([3]) in the 
cavity 

^ 7 

is then a random variable due to the thermal fluctuations of the Si. The clustering property of pure states of an 
equilibrium system ensures that the connected correlation functions of the spins tend to zero for TV ^ oo [l7j and 
therefore Hq^'^^ is a sum over many, asymptotically independent random variables. If all Joi are of the same order 
of magnitude this implies a Gaussian distribution of the cavity field uniquely characterized by its variance. Further 
manipulations generate a self-consistent equation for this variance from which all replica symmetric properties of the 
system may be derived. 

In the case of a Levy spin glass, however, a typical realization of the couplings Joi contains a few very large 
bonds. This invalidates the central limit theorem (the Lindeberg criterion is not fulfilled, see [lO]) and the cavity 
field distribution is not Gaussian. The traditional form of the cavity method for infinite range models is hence not 
applicable to the Levy spin glass. 

As observed by Cizeau and Bouchaud it is however possible to employ a variant of the cavity method as later 
used also in the analysis of spin systems on locally tree-like graphs [23| which is known to physicist as Bethe-Peierls 
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approximation [3l|, and to computer scientists as belief propagation (33| . This method builds on the fact that with 
Si being a binary quantity its marginal probability distribution 

PiS^) = ^ E exp(-/3i/({5,})) (8) 

can be parametrized by a single variable which we take to be the local field hi defined by 

h, := iartanh(S',) . (9) 



Accordingly we find 



as well as 

m, (S^) = tanhiph,) . (11) 

The local field must not be confused with the exchange field ([3]). Unlike the latter it is not thermally fluctuatin, 
If the cavity distribution is Gaussian the thermal average of the exchange field coincides with the local field [l 
However, in the general case and in particular for the Levy spin glass this does not hold. 
For the marginal distribution of the new spin Sq we have 

as well as 

AT 

P{So) = exp {pSo Jo^S^) P{{S,}) . (13) 
{SO »=i 

Using the clustering property in the form 

N f3hS- 

a straightforward calculation yields 

1^0 — artanh(tanh(/3fej) tanh(/3 — jy^)) • (15) 

As observed by Cizeau and Bouchaud one may be tempted to expand in the argument of the second tanh for N ^ oo 
to find the familiar expression 

^ Jo- 

i— 1 

However, this would be unjustified since some of the Joi/N^^" are not small. 

The local field ho as given by (fT5)) is a random quantity both due to its dependence on the old couplings Jij 
determining the hi and on the new couplings Joi. As long as \mi\ = | tanh(/3/ii)| < 1 the non-linearity in (|15p 
suppresses the influence of the few large Joi- As a consequence the second moment of the local field distribution 
P(/io) exists: 



Q : = h^ = artanh(tanh(/?/ii) tanh(/j ^^'^°'^ )) artanh(tanh(/3/ij) tanh(/3 ^^'^°'^^ )) 



Y artanh^(tanh(/3ft.,) tanh(/3-^^^)) 



^ j dhP{h) j dJPa(J) artanh^(tanh(/3/i)tanh(/3-^^^)). (17) 
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Cizeau and Bouchaud therefore argue that the central Umit theorem may be appHed and that P{ho) is Gaussian 
[21I [2^ . Using translational invariance of the ensemble averaged system P7|) may then be written as a self-consistent 
condition for Q. Using ^ this equation acquires the form 

Q = ^ / 75=^ •'^P (-^) / artanh2(tanh(/3/i) tanh(/3J)) , (18) 



where 



, , r(a + l)sin(f7r) , , 

C(a) := ^ > (19) 



is a numerical constant. 

Solving IjlSp numerically one obtains Q{/3) from which the free energy and all thermodynamics properties may be 
derived. In particular one easily verifies that the paramagnetic state with Q — is always a solution. It is stable for 
small /? and looses its stability at Pc given by 

l = ^^(«)/p^tanh2(/3cJ). (20) 



IV. REPLICA THEORY 
A. General setup 

Within the replica approach we employ the replica trick [l] to calculate the average in ([5|) , 

hIZ = lim ^—1 . (21) 

n^O n 

As usual we aim at calculating Z" for integer n by replicating the system n times, {Si} 1— s- {S°'}, a — 1, ...,n, and 
then try to continue the results to real n in order to eventually perform the limit n ^ 0. 

According to ([T|) and © the partition function is a sum of exponential terms with the exponents linear in the 
couplings Jij. Due to the algebraic decay Pq(J) ~ 1/| J|"+"'^ of the distribution Pq(J) for large \J\ the average Z"{(3) 
hence diverges for real f3 and we cannot proceed in the usual way. 

On the other hand, for a purely imaginary temperature, /3 = —ik, fc € R, A; > 0, we find from the very definition of 

Pa (J), cf. m 

Z^^Hfc)= ^exp(-^^|^5f5;[ + 0(l)) . (22) 

{S°} t,j a 

Note that the scaling of the interaction strengths with N used in ([T]) makes the replica Hamiltonian extensive as it 
should be. 

As characteristic for a mean-field system the determination of can now be reduced to an effective single site 
problem. To this end we use the notation S = {5°} for a spin vector with n components. It is then convenient to 
introduce the variables 



<S)^^Y.^{S--S), (23) 



N 

■I 

describing the fraction of lattice sites that share one out of the 2^^ reahzations of the spin vector S Clearly 

X]c(5) = l. (24) 
s 

Because of the identity 

1 fiS.,S,) =nJ2 ciS)ciS')f{S, S') (25) 

i'i S,S' 
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the exponent in p2|) is seen to depend on the spin configuration {Si} solely through the variables c{S). In order to 
transform the trace over {Si} into an integral over the c{S) we only need to determine the number of spin configurations 
that realize a given combination of c{S). A standard calculation yields to leading order in N 

E n''5(^ E ^(^- ^) - = exp ( - TV ^ c{S) In c(S^)) (26) 

{■s?} S ' s 



where the prime at the product denotes that the constraint ([21)) has to be taken into account. 
We may therefore write ([^^ in the form 



Z-Hk)^ Jl[dc{S)S{Y,c{S)-l) exp ( -iv[X]c(S^) In c(S^) + ^ 5^ clS'MS'OI^-^r]) • (27) 

S S S S,S' 

In the thermodynamic limit, N oo, the integral in (p7)) can be calculated by the saddle-point method. The 
corresponding self-consistent equation determining the saddle-point values c^°^ {a) of the c{a) is given by 

c(°)(a) = A(n)exp(-fc"^c("H5)|S'-ar) , (28) 

s 

where the Lagrange parameter A(n) enforces the constraint ([24]) . 



B. Replica symmetry 

Within the replica symmetric approximation one assumes that the solution of (j28p is symmetric under permutations 
of the replica indices. This impHes that the saddle-point values c^°^(S') may only depend on the sum, s J2a ^"'^ '^^ 
the components of the vector S. After the limit n ^ is performed the fmiction c*^"^ (s) can be related to the replica 
symmetric distribution P{h) of local magnetic fields ([9|) via [13] 

c(°)(s) = [dh P{h) 6-^'="^ P{h) = / ^ e'^'' c(°)(^) . (29) 

J J 2n k 

In this way the self-consistent equation (pS)) may be transformed to a self-consistent equation for P{h). 

To proceed along these lines in the present case we use (UHl in (1^5)1 and perform the following manipulations 



g -ikhs 



s s 

'^'"'^"'ifcrl^e*'-^ ^exp(-iA:/is-zf5-a) 

s 

^[|exp(-iS'°(A:/i + fcfa'^; 



27r 



27r 

s « 

^^|r|"e*'-^ [2cosfc(;i-|-f)]'^ [2cosfc(/i - f)]"^ (30) 
27r 



ZTT 



cos fc(/l -I- f) 
cos A;(/i — f) 



where the limit n — > was performed in the last line and a :— cr". Using A(n) ^ 1 for n — s- [27| we therefore 
find from (|28p in the replica symmetric approximation 

Using this result in (|29p we get 
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We are now in the position to continue this result back to real values of the temperature by simply setting k = i(3: 



ds 
2^ 



expUsh- I dh'P{h') I ^^|r|"exp( 



s cosh/3(/i' + f) 
2/3 cosh (3{h'-f) 



Finally the r-integral may be performed by using 



dr df 
2-K 



df 



- /(O)] if < a < 1 

1 [/W - /(O) - r/'(0)] if 1< a < 2 ' 



(33) 



(34) 



where /' denotes the derivative of / and C(a) is defined in p^ . In our case we have /(O) = 1 and /'(O) = as 
implied by P{h) — P{—h). Hence no distinction between a < 1 and a > 1 needs to be made. 

We therefore get finally the following self-consistent equation for the replica symmetric field distribution P{h) of a 
Levy spin glass at inverse temperature /3: 



Pih) = / ^ exp (ish + C{a) f dh'P{h') j -^"^ 



a+l 



exp — I— artanh(tanh (3h' tanh (if)^ — 1 



(35) 



The structure of this equation is rather similar to the corresponding equation for the VB model [l^. It is also 
interesting to look at the second moment of P{h) for which we find 



dhP{h)h^ = ^^ J dhP{h) j 1^1^ artanh^(tanh(/3/i)tanh(/3f)) 



(36) 



which is rather similar to (|18p . However, the P{h) solving ([55)1 is not Gaussian. This can be seen by inserting a 
Gaussian P{h') in the r.h.s. of ([35]) which then gets not reproduced on the l.h.s. 



C. Spin-glass transition 



The paramagnetic field distribution, P{li) = i5(/i), is always a solution of ([35]) . To test its stability we plug into the 
r.h.s. of ([55]) a distribution Po{h) with a small second moment, eo J dhPo{h) ^ 1, calculate the l.h.s. (to be 
denoted by Pi{h)) by linearizing in eo and compare the new second moment, ei :— ^ dhPi{h)h?, with eg- We find 
ei > eo, i.e. instability of the paramagnetic state, if the temperature T is smaller than the critical temperature Tc{a) 
given by 



C{a) 



dy 



tanh^(?;) 



l/a 



(37) 



This result coincides with ([20]) of the cavity approach. To determine the threshold value of /3 at which the distribution 
of local fields develops a non-zero second moment it is hence not decisive whether P{h) becomes Gaussian or not. In 
the limit a — > 2 (l37|) correctly reproduces the value T^^ = \f2 of the SK-model (111] . 

It is interesting to compare the temperature for the spin-glass transition with the temperature at which bonds 
satisfying Jij > TN^^" start to percolate. From ([2]) we find for the fraction c of these strong bonds per site 



2C{a) 



T- 



(38) 



Since the strong bonds are distributed independently from each other a giant component connected by these bonds 
appears for c > 1 [s^l- The percolation temperature is hence given by 



2C(a) 



a 



l/c 



(39) 



The dependence of Tc and Tp on a is displayed in fig. [T] The percolation temperature is always lower than the 
spin-glass temperature as expected since a percolating backbone of strong bonds is incompatible with a paramagnetic 
phase. On the other hand the two temperatures never coincide which means that also the many weak bonds contribute 
significantly to the spin-glass transition in Levy spin glasses. The transition is therefore not a pure percolation 
transitions. As can be seen from fig. [T] the difference between and Tp decreases with decreasing a in agreement 
with the fact that the tails of P{J) comprise a larger and larger part of the probability. 
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FIG. 1: Spin glass transition temperature Tc (full line) and percolation temperature Tp (dashed line) of an infinite-range spin- 
glass with Levy-distributed couplings as function of the parameter a of the Levy distribution defined in ([2]). For the scaling of 
the coupling strength with A'^ as chosen in ([1} there is a finite transition temperature for all values of a. 



D. Asymmetric distribution of couplings 



The replica calculation described above may be generalized to the case in which the distribution of couplings is not 
symmetric but shows a ferromagnetic bias, Pq(J) ^ Pa{—J)- The couplings are then drawn from a Levy distribution 
centered at N'^^^Jq where the A''-dependence of the shift guarantees that the repHca Hamiltonian remains extensive. 
Since a shift in the distribution amounts to a phase shift in the characteristic function the exponent of the replicated 
partition function is supplemented by 



^ Jo E • = -^P" E <^)c{S') S-S', 



S,S' 



where the identity (pS)) was used. The corresponding saddle-point equation then reads 



.(0) (a) = A(n) exp ( - fc" E '^^"^ (•^) I ' ^1 



i/c Jo E ^^"^-5) S-a 
s 



Using the RS ansatz we find for the new contribution 

-ikJo J dhP{h) E c'"^ 0) S-a^~ 
s 



fcJo / dhP{h) 



dr df 



cos k{h + f) 



= -kJo J dhP{h) J df S'{f) 
= — fc Jqct J dhP{h) tan(fc/i), 



cos k{h — f) 

cos k{h + f) 
cos A; (ft — f) 



(40) 



(41) 



(42) 



where the limit n — > was performed after the single-site trace was completed. Performing the step back to real 
temperatures k — i[3 we get a self-consistent equation for the replica symmetric field distribution. Since the field 
distribution is no longer symmetric for biased couplings, it is necessary to distinguish between the cases < a < 1 
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and 1 < a < 2. In the former case we get 



df 



„ exp ish + C(a) / dh'Pih') 
27r V J J \r 

-isJo I dh'P{h')t(inh(3h'] , 



exp ( — i— artanh(tanh/3/i' tanh/3f) ) — 1 



(43) 



while for the latter case the equation reads 
ds 



P{h) 



27r 



exp ish + C{a) / dh'P{h') 



df 



\a+l 



exp — i^artanh(tanh jSh' tanh /3r)^ — 1 + ifs tanh(/3ft,') 



is Jo / dh'P{h') tanh f3h' 



(44) 



From the structure of the self-consistent equation we again infer that the paramagnetic field distribution P{h) = 6{h) 
is always a solution. To test its stability we use the same procedure as in the previous section, taking into account 
that also a ferromagnetic instability may occur. To this end we plug into the r.h.s. of the self-consistent equation a 
distribution Po{h) with mean 70 := / dhPo{h)h ^ 1 and variance eo := / dhPo{h){h — 70)^ ^ 1. We calculate the 
l.h.s. (to be denoted by Pi{h)) to the leading order in the small parameters, and compare the resulting cumulants of 
the distribution Pi with the corresponding quantities of the distribution Pq. The phase transition from a paramagnetic 
to a ferromagnetic state occurs, if 



70 < 71 = JoPlo + 0(70: 7oeo, Eq)- 



(45) 



We therefore find an instability toward a ferromagnetic state at = Jq which is independent of a. The result for 
the spin glass transition temperature remains the same as in the unbiased case. 



V. NUMERICAL SIMULATIONS 



In order to check our analytical results for the spin glass transition temperature we have performed Monte Carlo 
simulations [s^, [sBl using the parallel tempering approach [stI. Iss!]. For a given realization {Jij} of the disorder, K 
independent configurations {Sf } (fc = 1, . . . , K) are simulated at K different temperatures Ti < T2 < . . . < Tfc, i.e. 
{S}} at Ti, at T2 etc 41]. One step of the simulation, i.e. one Monte Carlo sweep, consists of the following 

steps: 

• For each of the configurations k = 1, . . . , one sweep of local Metropolis steps is performed. Each sweep consist 
of N times selecting a spin io G {1, . . . , TV} randomly (uniformly). For each selected spin, the energy difference 
A£ between the current configuration {S^} and the configuration where just spin is flipped (5^^ ~^io) 
is calculated: Ai? = H{{S^}) - H{{S'^ \ - S^^}). The flip of spin is actually performed with the Metropolis 
probability pflip — min{l, exp(— AiS/T^)}, otherwise the current conflguration remains unaltered. 

• K —1 times an exchange step is tried: A temperature /co G {1, ■ • ■ , 1} is selected randomly, each temperature 
with the same probability 1/{K — 1). The energy difference AE^^^y, = H{{S^°}) - if({S'f''+^}) between the 
configurations at neighboring temperatures Tk^ and Tk^+i is calculated. The two configurations {S^°} and 
|^feo-l-i| exchanged with probability Pcxch — minjl, exp(— A£'oxch(l/T'fe(, — l/7feo+i))}. In this way, the 
configurations perform a random walk in temperature space and can visit all temperatures Tfc . 

Furthermore, for each temperature, we simulate two independent sets of configurations {S'^}, {Sf} which allows 
for a simple calculation of the overlap 

i 

at each temperature T^. From this overlap we calculate the Binder cumulant 
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1/1281/90 1/64 1/45 1/32 

1/N 



FIG. 2: Transition temperatures T*{N) for a — 1.25 (black) and a = 1.5 (red) as a function of the inverse system size. T*{N) 
is determined from the intersection points of the Binder parameters of the overlap q for system sizes A'' and 2N as shown in the 
inset for N = 128 and N = 256 {a = 1.5). The lines show fits for the finite-size scaling of the form T*{N) ^ Tc + aN^''. Here 
Tc{a = 1.25) ~ 1.172 and Tc{a = 1.5) ~ 1.254 respectively indicated by the boxes on the left of the figure are the analytical 
values for the critical temperatures as given by (|37|l whereas a and b are fit parameters. As can be seen the numerical results 
and the analytical values are compatible with each other. 



for all Tk and various values of N. The critical temperature is then determined from the intersection points of the 
lines Bpf{T) for different values of iV. 

We have found that the traditional single-spin local update works very well for large values of a > 1.5. For smaller 
values, the probability that bonds with a very large magnitude (e.g. \Jij\ > 10) appear in a realization becomes 
significant. A spin, which is adjacent to such a bond, will satisfy such a bond on all timescales, for the range of 
temperatures studied here. Hence, the spin will be frozen under single-spin-flip dynamics. For this reason, we have 
extended the local update by a cluster flip: In advance, all large bonds with \Jij\ > Jmax are determined. Next, we 
calculate the maximal components of sites connected by these large bonds. The cluster flip consist of an attempt to 
flip a randomly chosen cluster, i.e. all spins of the cluster simultaneously, with the usual Metropolis pfnp probability 
as stated above, where AE = H{{S^}) — i?({5f [cluster flipped}). Note that the clusters contain only spin indices, 
i.e. are indpependent of the actual relative orientations of the spins, since these might change during the simulation 
by other update steps, e.g. the standard single-spin-flip step. 

In case of a single chosen value of Jmax, if Jmax is large, then the clusters will be small, which might lead, in some 
cases, not to frozen single spins but to some practically frozen clusters. On the other hand, if Jmax is small, the 
clusters will be large, hence the spins inside a cluster are frozen relative to each other. To avoid these problems, we 
have generated, before the actual simulation starts, several sets C„ of clusters for different values of Jmax- We started 
at Jmax = 2Tr- to obtain Ci. Then we increment Jmax iterativly by 1. A new set C„ is stored, if it differs from 
the previous set C„_i. This is continued until Cn^^^ consists only of clusters of size 2. During the simulation of the 
single configurations, each time the local Metropolis step is chosen with probability p = 0.8 and a cluster attempt 
with probability 1 — p = 0.2. Note that for the Metropolis step still all spins are considered for single-spin flips, 
independent on how the clusters look like. Hence, large bonds which are not satisfied will become satisfied in this way, 
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and also there is a small probability that bonds with a large magnitude become unsatisfied during the simulation. 
Hence, ergodicity is guaranteed. For the cluster attempt, one set C„ of clusters is selected randomly (all with the 
same probability), and from the set one cluster, again with equal probability. Hence, detailed balance is fulfilled. 

After checking our code by reproducing the known result Tc(a = 2) = \/2 for the SK model we have investigated 
the cases a — 1.25 and a = 1.5 in more detail. Guided by the analytical result for Tc{a — 1.25) ~ 1.172 and 
Tc{a — 1.5) ~ 1.254 we chose in both cases 19 temperatures in the range [0.87 : 2.0]. The temperatures Ti are 
determined such that for the largest system size N = 256 the average acceptance rate of the exchange steps is at least 
0.5 for all pairs of neighboring temperatures. For all system sizes, the same set of temperatures is used, which allows 
for a better comparison of the results. 

At the beginning of the simulation all configurations are random. We equilibrate the system until the squared 
overlap as a function of time, averaged over the last half of the simulation, has become independent of the number 
of Monte Carlo sweeps for all temperatures. Furthermore, we verify that the distribution of overlaps measured during 
this period is symmetric with respect to g = 0. For the case a = 2.0, we have additionally employed the equilibration 
criterion from [39| and verified that the above listed criteria are compatible with it. 

After equilibration, spin configurations are stored for later analysis at all temperatures every At Monte Carlo 
sweeps. At is chosen such that it corresponds to the typical time one configuration needs to walk in temperature 
space from the lowest temperature Ti to the highest Tk and back to Ti. Since at the highest temperature, well above 
the phase transition temperature, the configurations forget their history at low temperatures, the stored configurations 
are statistically independent. Typical values for At range from At — 150 {N — 32) to At — 250 {N — 256). For each 
realization, we sample 1000 configurations and average for each system size over 1000 realizations. The results for 
obtained in this way are compatible with the theoretical result as shown in fig. [5) 

VI. DISCUSSION 

Infinite-range spin glasses with Levy-distributed couplings are interesting examples of disordered systems. Due to 
the long tails in the distribution of coupling strengths they interpolate between systems with many weak couplings 
per spin as the Sherrington-Kirkpatrick model and systems with few strong couplings per spin as the Viana-Bray 
model. The broad variations in coupling strengths brought about by the power-law tails in the Levy distribution 
violate the Lindeberg condition for the application of the central limit theorem and give rise to non-Gaussian cavity 
field distributions with diverging moments. In the present paper we have shown that it is nevertheless possible to 
derive the replica symmetric properties of the system in a compact way by using the replica method as developed for 
the treatment of strongly diluted spin glasses and optimization problems |27.] . This approach focuses from the start 
on the complete distribution of fields rather than on its moments. 

The central result of our analysis is the self-consistent equation for the distribution of local fields, P{h), as given 
by eq. (|35p . From this equation the expression (|37p for the critical temperature of the spin glass transition may be 
derived. In Levy spin glasses there is for all temperatures a fraction of strong bonds per site which cannot be broken 
thermally. Comparison of the spin-glass transition temperature with the temperature at which these strong bonds 
start to percolate through the system reveals that the spin-glass transition in a Levy glass is not a pure percolation 
transition. The contribution of the many weak couplings cannot be neglected and becomes increasingly important as 
the parameter a in the Levy distribution approaches the limit a = 2 corresponding to the SK model. 

Our results show similarities and differences with those of the cavity analysis of Cizeau and Bouchaud 21]. The 
results for the critical temperature arc the same because the expressions for the second moment of the local field 
distribution coincide. However, we do not find a Gaussian distribution of local fields for T < Tc as assumed by Cizeau 
and Bouchaud on the basis of the cavity expression (fTS]) . From the numerical solution of TAP equations for the SK 
model it is known that for all T < Tc a certain fraction of local magnetizations rui — tanh phi are extremely near to 
1 [i^ . As this seems likely to be the case in Levy spin glasses as well it is conceivable that the distribution of hi in 
(jl5p is such that the Lindeberg criterion is again violated and that the central limit theorem may not be applicable. 

Several open questions may be addressed in forthcoming work in order to completely characterize the properties 
of Levy spin glasses. First the self-consistent equation for P{h) should be solved, either numerically or analytically 
in limiting cases. Building on these results the replica symmetric picture of the low-temperature phase may be 
completed and compared with the findings from the cavity approach. Since replica symmetry is certainly broken at 
low temperature a stability analysis of the RS saddle point (|28)) needs to be performed and it is to be checked whether 
the deAlmeida-Thouless temperature Tat is indeed smaller than Tc as found within the cavity approach. Finally the 
structure of the solution with broken replica symmetry is to be elucidated. Within the replica approach adopted in 
the present paper this is known to be very complicated such that for this task a cavity analysis looks more promising. 
Finally, improved numerical simulations will contribute to a better understanding of the intricate properties of Levy 
spin glasses. 
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